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ABSTRACT 

Objective: To verify whether vaccination against the 
A-H1N1 virus in the paediatric population was effective 
in preventing the occurrence of influenza-like illness 
(ILI) or was associated with adverse events of special 
interest. 

Design, setting and patients: A case-control 
analysis was performed as part of surveillance of 
children hospitalised through the emergency 
departments of eight paediatric hospitals/wards for ILI, 
neurological disorders, non-infectious muco- 
cutaneous diseases and vasculitis, thrombocytopaenia 
and gastroduodenal lesions. 
Results: Among 736 children enrolled from November 
2009 to August 2010, only 25 had been vaccinated 
with the pandemic vaccine. Out of 268 children 
admitted for a diagnosis compatible with the adverse 
events of special interest, six had received the A-H1N1 
vaccine, although none of the adverse events occurred 
within the predefined risk windows. Only 35 children 
out of 244 admitted with a diagnosis of ILI underwent 
laboratory testing: 1 1 were positive and 24 negative for 
the A-H1N1 virus. None of the A-H1N1 positive 
children had received the pandemic vaccine. The OR of 
ILI associated with any influenza vaccination was 0.9 
(95% CI 0.1 to 5.5). 

Conclusions: The study provides additional 
information on the benefit-risk profile of the pandemic 
vaccine. No sign of risk associated with the influenza 
A-H1N1 vaccine used in Italy was found, although 
several limitations were observed: in Italy, pandemic 
vaccination coverage was low, the epidemic was 
almost over by mid December 2009 and the A-H1N1 
laboratory test was performed only during the 
epidemic phase (in <10% of children). This study 
supports the importance of the existing network of 
hospitals for the evaluation of signals relevant to new 
vaccines and drugs. 
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BACKGROUND 

Great concern about the severity of the 
A-HINI influenza epidemic in the paediatric 
population was expressed at international level 
m 2009/ ^ The main public health response 
was considered to be the development of 
and access to new vaccines against the 



Article focus 

■ To assess the effectiveness of the influenza 
A-HINI vaccine and the occurrence of adverse 
events of special interest in the paediatric 

P population. 

Key messages ^ 

■ During the 2009-2010 influenza season, very 
limited information was available on the safety 
and effectiveness of the influenza A-HINI 
vaccine. 

I ■ Together with other post-marketing studies, our 
findings provide additional information on the 
benefit-risk profile of the pandemic vaccine. 

Strengttis and limitations of tills study ^ 

■ The study focused on influenza-like illness and 
adverse events of special interest that were 
sufficiently severe to cause hospitalisation in 
children and provided additional information on 
the benefit-risk profile of the pandemic vaccine. 

■ A-HINI vaccination coverage in Italy during the 
2009-2010 influenza season was very low, with 
around 4% of the general population and only 
3.7% of the children included in this study having 
been vaccinated. 

■ The influenza outbreak was almost over by the 
first half of December 2009, and both the 
incidence and severity of the disease were 
lower than expected. 



A-HINI virus. However, due to the limited 
availability of data, there was widespread 
uncertainty about the efficacy and safety of 
the pandemic vaccines, which could not be 
resolved in the short time available before 
vaccine approval, even though authorities 
had laid down the procedures to be 
completed in case of a new epidemic.'^ 

To ensure public safety during the influ- 
enza outbreak, rapid access to the new 
influenza A-HINI vaccines was offered to 
high-risk groups such as pregnant women, 
young infants and immune-compromised 
patients. There were also specific concerns 
about the potential risks of adverse events 
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associated with the adjuvant included in some of the A- 
HlNl vaccines and with the concomitant use of other 
influenza vaccines. 

Regulatory agencies around the world require 
companies to carry out post-marketing surveillance 
studies on newly developed vaccines. However, because 
of the limited time available during this emergency, 
research groups already involved in the efficacy and 
safety assessment of drugs and vaccines were invited to 
focus their activities on the pandemic vaccines.* In Italy, 
a national pharmacovigilance pandemic plan, with 
specific focus on safety in the paediatric population, was 
implemented.' 

Active surveillance of the role of drugs and vaccines 
in the occurrence of selected clinical conditions 
responsible for paediatric hospitalisation has been 
conducted in Italy since 1999. This surveillance so far 
has proved useful in the detection, description and 
evaluation of risk signals associated with drugs and 
vaccmes used in children.*^"*^ During the 2009-2010 
pandemic season, following the launch of the vaccina- 
tion campaign by the Italian Ministry of Health,'' the 
study protocol of the existing surveillance system was 
adapted to focus on and include evaluation of the safety 
and efficacy of the A-HINI vaccine. In Italy the immu- 
nisation campaign started in October in healthcare 
workers and was subsequently extended to pregnant 
women and other at-risk groups, including children. 
After some weeks vaccination was offered to all citizens. 
Focetria, administered free of charge by the Italian 
NHS, was the only available pandemic vaccine. 

The purpose of this study was to assess effectiveness of 
influenza A-HINI vaccination in the paediatric popula- 
tion for preventing the occurrence of influenza-like 
illnesses (ILI) requiring hospitalisation. Moreover, 
we assessed the safety of the vaccine, in particular by 
evaluating all the adverse events of special interest 
(AESI) reported in the exposed population. 

METHODS 
Study population 

This study consisted of active surveillance of children 
hospitalised from November 2009 to August 2010 
through the emergency departments (EDs) of eight 
clinical centres for selected conditions, regardless of 
their previous drug and vaccine exposure. The study 
population consisted of all children (aged 1 month— 18 
years) admitted for the four following conditions: (i) 
neurological disorders; (ii) non-infectious muco-cuta- 
neous diseases and vasculitis; (iii) thrombocytopaenia; 
and (iv) confirmed gastroduodenal lesions (and/ or 
clinically defined haematemesis or melena). The first 
three conditions cover nearly all diagnoses compatible 
with vaccine related AESI and were considered for 
vaccine safety evaluation. 

Children older than 6 months hospitalised for ILI, as 
judged by the clinicians in the ED, were also enrolled in 
the study to estimate the effectiveness of influenza 



A-HINI vaccination. For children >5 years of age, the 
following definition of ILI was adopted: sudden onset of 
fever >38°C (for at least 24 h) in association with at least 
one respiratory symptom (cough, sore throat, coryza) 
and at least one general symptom (headache, asthenia, 
malaise). For children between 6 months and 5 years of 
age, in association with fever >38°C, the following 
general sign and symptoms were considered: inadequate 
drinking or feeding, vomiting and/ or diarrhoea and 
respiratory symptoms.' 

Assessment of the presence of influenza A-HINl virus 
by laboratory test was not an inclusion requirement. 
Both clinically defined and laboratory confirmed hospi- 
talisations for ILI were considered of interest in evalu- 
ating the effectiveness of the influenza vaccines. Given 
the non-interventional nature of the study design, we 
had to rely on the usual practice of participating hospi- 
tals. Moreover, following a recommendation of the 
Italian Ministry of Health, laboratory confirmation of 
A-HINI virus was not routinely suggested after the 
epidemic began to decline (mid December 2009) 
(figure I). In order to limit selection bias (ie, selective 
enrolment of vaccinated children), participating centres 
were asked to enrol ILI cases on a specified day of the 
week (up to three or four consecutive cases per week) 
blind to vaccination status. This recruitment strategy 
applied to all ILI cases and was independent of the 
decision to carry out laboratory confirmation. 

Data source 

After providing informed consent, parents were inter- 
viewed by a trained investigator, using a structured 
questionnaire, during the hospital admission of the 
child. The interview sought to obtain the relevant history 
and to ascertain drug use and vaccination status. As 
reported in the study protocol, the information on drug 
and vaccine exposure was not validated. 

For drug exposure, the time window of interest was the 
3 weeks before the onset of symptoms related to the 
hospital admission. With regard to vaccine exposure, the 
12 weeks preceding the hospitalisation were considered 
of interest for all non-influenza vaccines. For the assess- 
ment of the effectiveness of both the A-HINI and 
seasonal influenza vaccines, children were considered 
exposed if vaccinated any time before admission. To 
evaluate any possible relationship between vaccination 
and AESIs, time windows specific for each AESI were 
considered, for example 0—2 days for urticaria^ 
0—14 days for convulsions and 0—42 days for thrombo- 
cytopaenia, vasculitis, neuropathies, etc.^^ 

Data analysis 

Two different comparisons were conducted to assess 
vaccine effectiveness and estimate the ORs. For the first 
comparison, all children hospitalised for ILI were 
considered as cases, while children >5 months old 
enrolled for any of the four clinical conditions described 
above acted as controls. For the second comparison, the 
analysis was restricted to all children admitted for ILI 



2 



BMJ Open 201 1 ;2:e0001 67. doi:1 0.1 1 36/bmjopen-201 1 -0001 67 



Effectiveness and safety of the A-H1N1 vaccine in children: a case-control study 



Figure 1 Effectiveness and 
safety of the A-H1N1 vaccine, 
y, years. Adapted from iittp://www. 
iss.it/binary/iflu/cont/2009_2010.pdf. 
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and tested for the A-HINI virus. ILI patients with 
a positive test were considered as cases, while those with 
a negative test acted as controls. The purpose of the first 
analysis was to provide an estimate of the effectiveness of 
the vaccines in preventing hospitalisation for any ILI 
during the influenza season. The second analysis was 
aimed at estimating the ability of the A-HINI vaccine to 
prevent the occurrence of confirmed episodes of 
pandemic influenza. 

Assuming 50% of children were vaccinated, a power of 
90% and an a error of 0.05, a sample size of 194 hospi- 
talisations for ILI was required to estimate a reduction of 
at least 50% in the occurrence of ILI among vaccinated 
children (OR<0.5). 

Adjusted ORs and related 95% CIs were calculated 
through a multivariate logistic model. Data were 
analysed with SPSS V.I 7. 

Study sites 

The following paediatric hospitals and departments 
participated in the study: Giannina Gaslini Paediatric 
Hospital (Genoa), Regina Margherita Paediatric 
Hospital (Turin), Department of Paediatrics, University 
of Padua (Padua), Anna Meyer Children's University 
Hospital (Florence), Pharmacology and Paediatrics and 
Developmental Neuroscience, Universita Cattolica Sacro 
Cuore (Rome), Emergency Department, Bambino Gesu 
Children Hospital (Rome), Santobono-Pausilipon 
Paediatric Hospital (Naples) and Giovanni Di Cristina 
Paediatric Hospital (Palermo). The protocol of the study 
was submitted to the ethics committee of each clinical 
centre for approval. The eight centres account for 
around 350 000 ED visits annually (around 50 000 chil- 
dren are subsequently hospitalised through the ED) and 
are located in northern, central and southern Italy. The 
study was coordinated by the National Centre of Epide- 
miology of the National Institute of Health. 



RESULTS 

From 1 November 2009 to 31 August 2010, 736 children, 
with a median age of 4 years (range I month— 18 years), 
were enrolled. Overall, 492 children were hospitalised 
for at least one of the four conditions of interest in this 
study: 241 (49%) for neurological disorders, 144 (29%) 
for muco-cutaneous diseases, 60 (12%) for thrombocy- 
topaenia and 47 (10%) for gastro-duodenal lesions. A 
total of 244 children were admitted with a diagnosis of 
ILI (table I). The male to female ratio was largely similar 
in the different diagnostic groups. 

Among those with neurological conditions, convulsion 
was the most frequent cause of admission (N=91; 38%), 
followed by disturbances of vigilance and consciousness, 
for example, numbness, somnolence and lipothymia 
(N=39; 16%) and by apparent life threatening events 
(N=30; 12%). Some children with serious clinical 
conditions were admitted: eight with peripheral 
neuropathies and five with Guillain-Barre syndrome. 
More than half of those with muco-cutaneous diseases 
had Schoenlein-Henoch purpura or other vasculitis 
(N=80; 55%), followed by urticaria (N=32; 22%) and 
erythema (N=15; 10%). 

Of the children enrolled in the study, 71% had been 
exposed to at least one drug in the 3 weeks preceding 
hospital admission. A total of 173 children (24%) had 
been vaccinated before hospitalisation (either at any time 
for the influenza vaccines or during the preceding 
12 weeks for the other vaccines). Hexavalent vaccine was 
most frequently reported (55 children), followed by the 
antipneumococcal (37 children) and MMR (24 children) 
vaccines. 

For the influenza vaccine analysis, the denominator 
was limited to the 683 children at least 6 months of age 
(according to the vaccination schedule for the pandemic 
vaccine). In this population (244 admitted for ILI and 
439 for the other conditions), 25 children (3.7%) had 
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Table 1 Distribution of cliildren hospitalised for the study conditions 



Conditions 


Patients, 
N (%) 


IVIedian 
age (IQR) 


Female, 
N (%) 


Exposed to 
drua(s) N (%) 


Exposed to 
vaccine,* N (%) 


Underlying 
clironic 

diseases, N (%) 


Neurological disorders 


241 (49) 


4(9) 


112 (47) 


166 (69) 


53 (22) 


35 (15) 


Muco-cutaneous 


144 (29) 


5(5) 


53 (37) 


110 (76) 


18 (13) 


14(10) H 


diseases and vasculitis 














Thrombocytopaenia 


60 (12) 


4(7) 


21 (35) 


40 (67) 


17 (28) 


10(17) M 


Gastroduodenal 


47 (10) 


5(6) 


20 (43) 


33 (70) 


8(17) 


6 (13) ■ 


lesions 














Total 


492 (100) 


4(7) 


206 (42) 


349 (71) 


96 (20) 


65 (13) ^1 


Influenza-like illness 


244 


3(3) 


108 (44) 


170 (70) 


77 (32) 


58 (24) 



*AII vaccines administered to the study subjects, and not only those with influenza, are included; 25 children exposed to the pandemic vaccine 
were distributed as follows: six cases (2.5%) were hospitalised for neurological disorders, 4 (2.8%) for muco-cutaneous diseases and vasculitis, 
2 (4.3%) for gastroduodenal lesions and 13 (5.3%) for influenza-like illness. IQR, interquartile range. 



received the pandemic vaccine (nine children received 
two doses) and 45 (6.6%) had been vaccinated against 
seasonal influenza. Eleven children received both 
vaccines and in nine children the type of influenza 
vaccine was not specified. All immunised children (those 
with ILI and controls) had received the influenza 
vaccines more than 14 days before hospitalisation. 

Out of 268 children admitted for a diagnosis compat- 
ible with AESI, only six had been previously vaccinated 
with the A-HINI vaccine (two cases of urticaria, two 
convulsions, one vasculitis and one Schoenlein-Henoch 
purpura), however, all admissions occurred outside the 
predefined risk windows (table 2). 

Regarding evaluation of the effectiveness of the 
pandemic vaccine to prevent ILI episodes, regardless of 
any positive laboratory test, all estimates were above 1 
(table 3). Specifically, the adjusted ORs were 2.1 (95% CI 
1.1 to 4.1) for the seasonal vaccine and 1.3 (95% CI 0.6 
to 3.1) for the pandemic vaccine. No difference in the 
OR estimates was observed when the analysis was 
restricted to the pandemic period (ie, October 
2009-January 2010). 

Among the 35 children who underwent laboratory 
testing, 11 were positive and 24 negative for the A-HINI 
virus (table 4). Since none of the A-HINI positive chil- 
dren had a positive history for A-HINI vaccination, it was 
not possible to obtain an estimate of vaccine effective- 
ness. Given the prevalence of exposure among controls, 



Table 2 Children admitted with a diagnosis of AESI and 
vaccinated with the pandemic vaccine 




Interval 


Within the 


Diagnosis 


(days) 


risk period 


Urticaria 


20 


No 


Schoenlein-Henoch purpura 


47 


No 


Urticaria 


60 


No 


Vasculitis 


128 


No 


Convulsions 


149 


No 


Convulsions 


188 


No 


AESI, adverse events of special interest. 



the likelihood of none of the 1 1 children with confirmed 
influenza having been immunised with the pandemic 
vaccine was 0.35. The OR of ILI associated with any 
influenza vaccination was slightly lower than 1 (OR 0.9; 
95% CI 0.1 to 5.5). 



DISCUSSION 

One of the main strengths of this study was the 
promptness in adapting the protocol of an existing study 
involving a network of hospitals to respond to the health 
alert created by the pandemic emergency. Despite the 
large Italian paediatric population enrolled, the results 
concerning the safety and effectiveness of the pandemic 
vaccine were partly inconclusive. Several reasons may 
have contributed to this outcome. A-HINI vaccination 
coverage in Italy during the 2009—2010 influenza season 
was very low at around 4% of the population^'^ and only 
3.7% of the children included in the study. The influ- 
enza outbreak was almost over by the first half of 
December 2009, and both the incidence and severity of 
the disease were lower than expected. As a consequence, 
the Italian population did not adhere to the second part 
of the immunisation campaign planned for January 
2010. The epidemic curve during the 2009-2010 influ- 
enza season in Italy and the start of the vaccination 
campaign are shown in figure 1. To further complicate 
the picture, since A-HINI laboratory tests were 
performed only during the epidemic phase, less than 
10% of children hospitalised for ILI during the study 
period were tested. 

These difficulties were also observed in other Euro- 
pean countries. Avery low level of vaccination was found, 
for instance, in the multinational European study 
Influenza — Monitoring Vaccine Effectiveness 
(I-MOVE),^* which was a practitioner-based outpatient 
surveillance study conducted in seven countries. Five of 
the seven countries were unable to contribute more than 
one vaccinated patient with confirmed A-HINI influ- 
enza. Only the pooled analysis derived from the inter- 
national collaboration was able to estimate vaccine 
effectiveness. 
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Table 3 OR of influenza-like illness in association with immunisation status 



Vaccines 


Cases (244) 


Controls (439) 


Crude OR (CI 95%) 


Adjusted* OR (CI 95%) 


Any flu vaccinest 


41 


27 


3.1 (1.8 to 5.3) 


2.7 (1.6 to 4.7) M 


A-H1N1 vaccine 


13 


12 


2.2 (0.9 to 5.3) 


1.3 (0.6 to 3.1) ■ 


Seasonal vaccine 


27 


18 


3.0 (1.6 to 5.9) 


2.1 (1.1 to 4.1) ^ 


Not vaccinated 


203 


412 


Reference 





Cases: all children hospitalised for I LI; controls: children hospitalised for thrombocytopaenia, gastroduodenal lesions, muco-cutaneous or 
neurological conditions; only children above 6 months of age are included. 

*Adjusted by age and chronic diseases; the ORs of A-H1N1 and seasonal vaccine were also adjusted for the other influenza vaccine, 
fin seven cases and two controls, the type of vaccine was not specified. 



s or 

'J 



Despite the limitations, our study provided additional 
information on the benefit— risk profile of the pandemic 
vaccine. There were no reports of AESI associated with 
vaccine use in children. These findings are consistent 
with those reported by experimental and observational 
studies, including analysis of spontaneous reporting 
systems. ^■^"''^ In conclusion, even with the limitation of 
a low level of immunisation, no risk associated with the 
A-HINI vaccine used in Italy was described. Among the 
clinical diagnoses compatible with AESI, none was 
reported in relation to vaccination in the predefined risk 
period. 

Regarding effectiveness, as in other studies conducted 
in adult populations, a strong confounding effect was 
observed.^'' For instance, immunisation with the 
seasonal vaccine was associated with a crude OR of >3. 
Since the viruses included in the seasonal vaccine were 
not circulating in the 2009—2010 season, this OR may 
simply represent the effect of a greater prevalence of 
influenza risk factors, mainly fragile patients, among 
those immunised. Of note, when a protective effect was 
expected, as for the pandemic vaccine, we observed 
a wide difference between the crude and the adjusted 
ORs (2.2 vs 1.3) associated with A-HINl vaccination. The 
crude OR was adjusted by age and presence of chronic 
diseases; the OR of A-HINI and the seasonal vaccine 
were also adjusted for the other influenza vaccine. The 
fact that even the adjusted OR remains above unity is 
compatible with the presence of residual confounding 
factors that we were unable to control for due to the 
limited power of the study. 



Table 4 OR of influenza-like illness in patients who tested 
positive for A-HINI virus 





Cases 


Controls 


Crude OR 




(11) 


(24) 


(CI 95%) 


Any flu vaccines* 


3 


7 


0.9(0.1 to 5.5) 


A-HINI 


0 


3 




vaccine 








Seasonal 


2 


6 


0.7(0.1 to 5.3) 


vaccine 








Not vaccinated 


8 


17 


Reference 



Cases: patients with influenza-like illness (ILI) who tested positive 
for the A-H1 N1 virus; controls: ILI patients who tested negative for 
the A-H1N1 virus. 

*ln one case and one control, the type of vaccine was not specified. 



A required sample size of 194 children hospitalised for 
ILI was estimated in the protocol. Despite the fact that 
244 children with this diagnosis were enrolled, the power 
proved inadequate given the low level of vaccination. 
However, the sample size estimate, based on the 
hypothesis that at least 50% of the paediatric population 
had been vaccinated, was reliable at the time the 
protocol was written. 

As foreseen in the study protocol, a more valid esti- 
mate of vaccine effectiveness was derived from the 
comparison between test-positive and test-negative 
ILIs.^*' Considering the reasonable hypothesis that 
effectiveness is limited to the strains included in the 
vaccine, cases of interest should concern hospitalisations 
for ILI attributable to the influenza viruses against which 
the vaccine was developed. Test-negative ILIs are there- 
fore a valid control group (the source population of 
cases). It would be impossible to differentiate between 
cases and controls on the basis of the clinical symptoms 
that prompted admission. Moreover, children hospital- 
ised for an episode of ILI would more likely share similar 
risk factors for influenza. Finally, since information on 
vaccine status was collected in a similar way and in the 
same setting for both cases and controls, recall bias can 
be reasonably excluded. 

In this study, we reported that given the low number of 
children affected by ILI who underwent laboratory 
testing, we could not estimate vaccine effectiveness (only 
35 children were tested and no child who tested positive 
for A-HINI had been vaccinated against the HlNl 
virus). To support the assumption of a beneficial effect 
of pandemic vaccination, our findings need to be 
corroborated by those of similar studies. 

We consider it was worthwhile conducting the study 
even though the findings might be considered only 
exploratory. One of the main results of this process was 
to test the usefulness of an integrated model for 
conducting evaluations of the benefit— risk profile of 
vaccines in children. 

Had the influenza pandemic been more severe and 
prolonged, we would have been able to capture safety 
signals as well as estimate vaccine effectiveness. However, 
our findings may contribute to pooled estimates 
together with those of similar investigations. Last but not 
least, this study further supports the importance of active 
hospital-based surveillance which can easily be adapted 



BMJ Open 201 1 ;2:e0001 67. doi:1 0.11 36/bmjopen-201 1 -0001 67 



5 



Effectiveness and safety of the A-H1N1 vaccine in children: a case-control study 



to capture saifety and effectiveness signals for new influ- 
enza vaccines or new drugs. 
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